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Cross Reference to Related Applications 

This application is a continuation-in-part of the following applications: WlPO . 
00/02634, filed July 1 0. 2000 and UK application 1 6938,3. also filed July 1 0, 2000. 
the disclosures of Which are incorporated herein by reference. Certain claims may 
benefit from the priority of these applications. 

Background of Invention 

[0001] The present invention relates to an equalization technique useful for transmitting 
symbols of high-order constellations that are subject to corruption by inter-symbol 
interference and other data correlated noise (collectively, "ISI"). ISI refers to a variety of 
phenomena in data processing systems in which a data signal interferes with itself at 
destination. The present invention also relates to the use of reliable symbols to 
determine values of source symbols that are corrupted by ISI. The present invention 
finds particular application in systems where source symbols are members of high- 
order constellations. Previously, such systems have required the use of training 
symbols for operation in the presence of real-world ISI phenomenon, 

[0002] FIG. 1 illustrates an exemplary data processing system 100 in which ISI may occur. 
A source 1 1 0 may generate a data signal D (herein, a source data signal). When 
delivered to a destination 1 20 as a received signal X, the source data signal D may be 
corrupted by ISI sources within a channel 1 30. For example, multiple copies of a 
single data signal D may be captured at the destination 1 20. each copy being received 
with an unknown time shift and gain with respect to the other copies. Further, the 
time shifts and gains may vary over time, 

[0003] ISI phenomena may be modeled mathematically. In the case where the data signal 
D is populated by a number of data symbols dn. captured signals xn at the destination 
1 20 may be represented as: 



[0004] 

Xn =ao +'ldn-K,. ".dn-l,dn+l, ■••,dn+K,)+<Bn. (1) 

[0005] where aO represents a gain factor associated with the channel 1 30, f(d d 
. . , . , ' n-k2 

) IS a functional representation that relates the IS! to the symbols d d 

n-kl 

n+kl ' ""^'"9 ISI corruption and uj n represents corruption from other sources. In 
linear systems, Equation 1 may reduce to: 

[0006] 

''n=<ln+ Sai-dn-i+Onr (2) 

l»0 

[0007] where a a represent the sampled values of the impulse response of 

the channel. In accordance to common practice, the values ai have been normalized by 
the value of aO in Equation 2. 

[0008] ISI is seen as a serious impediment to the use of high-order constellations for 
data processing systems. A constellation is a set of unique values (constellation 
points) that may represent data symbols. Higher order constellations define a greater 
number of constellation points than lower order constellations. For example, symbols 
from a binary constellation, one having only two constellation points, can represent 
only a single digital bit per symbol. By contrast, symbols from an eight-point 
constellation, a sixteen-point constellation or a 256-point constellation can represent 
three, four or eight digital bits per symbol. At a common symbol rate, these higher 
order constellations can yield higher data throughput than lower order constellations. 

[0009] Unfortunately, blind equalization (equalization without either an initial training 

sequence, or "refresher" training sequences) is very hard to achieve with higher order 
constellations. The detrimental effects of ISI increase with increasing constellation 
order due to a greater contribution from the Z (ai*dn-i) term of Equation 2. 



[0010] 



The inventors" co-pending patent application entitled. Reliable Symbols as a 
Means of Improving the Performance of Information Transmission Systems, filed April 
18, 2001 having serial no. 09/836,281 , discloses several techniques for blind 
estimation of ISI in transmission systems using high-order constellations. The 
invention described herein and the work presented in the inventors" co-pending 
foreign applications are believed to be the first practical blind equalization techniques 
suitable for high-order constellation data systems. The inventors believe that the 
disclosures herein and the methods described in the co-pending patent applications 



enable an increased^pnber of reliable symbols to be obtain^^om captured samples 
and that this increases the rate and effectiveness of equalization. 

Brief Description of Drawings 

[001 1] FIG. 1 illustrates an exemplary data processing system in which ISI may occur. 

[001 2] FIG. 2 is a block diagram of an equalizer according to an embodiment of the 
present invention. 

Detailed Description 

[001 3] Embodiments of the present invention provide fast equalization techniques for 
systems using high-order constellations where symbols have been corrupted by ISI. 
The technique allows ISI estimation to begin immediately upon receipt of captured 
samples. ISI estimation is weighted according to a reliability factor of each captured 
sample. 

[0014] FIG. 2 is a block diagram of an equalizer 200 according to an embodiment of the 
present invention. The equalizer 200 may include a symbol decoder 210, an ISI 
estimator 220 and a pair of buffers 230, 240. The symbol decoder 210 may estimate 
decoded symbols d^n from a sequence of captured samples xn based on a current 
estimate of ISI coefficients (labeled {a^i} in FIG 2). Decoded symbols d^n may be 
stored in a first buffer 230; captured samples xn may be stored in a second buffer 
240. The ISI estimator 220 may generate new estimates of the ISI coefficients a^i 
based on the symbols dAn and samples xn from the buffers 230, 240. 

[001 5] The equalizer 200 shown in FIG. 2 advantageously permits decoding to occur 

immediately upon receipt of captured samples xn even before an accurate estimate of 
the ISI coefficients {aAi} are available. Thus, the decoded symbols dAn output by the 
symbol decoder 210 may have large error initially. Over time, however, as more 
decoded symbols dAn become available, the ISI estimator 220 may develop 
increasingly improved estimates of the ISI coefficients and improve the accuracy of the 
decoded symbols dAn estimated by the symbol decoder 210. 

[001 6] ISI ESTIMATION USING RELIABILITY WEIGHTING 

[001 7] Having estimated decoded symbols dAn from the captured samples xn, the ISI 
estimator 220 may revise ISI coefficient estimates. To simplify the nomenclature 
herein, consider a case where the buffers 240, 230 respectively store a predetermined 
number L of samples xn and decoded symbols dAn (n=l to L). 



[001 8] In an embodime^^he ISI estimator 220 may employ a l^^squares estimation to 
update the ISI coefficients according to: 



[0019] 



{a} = (H^^r^H'^WA (3) 



[0020] where: {aA} is a vector of estimated normalized ISI coefficients. A is a vector that 
contains elements A n^xn-d^n, representing the difference between the received 
samples xn and the related decisions d^n, H is an LxK matrix containing surrounding 
symbol estimates, and W is an LxL diagonal weight matrix having weights wn,n that 
are derived from a reliability factor of an associated captured sample (wi j = 0 for all i 
* j). The weight may increase or remain constant with decreasing reliability factor. 

[0021] In an embodiment, the H matrix may be populated by symbol estimates obtained 

from the symbol decoder. It may be constructed as an LxK matrix in which each of the 

L rows contains symbol estimates surrounding the estimated symbol to which the row 

refers. For example, an ith row may relate to a symbol estimate dAj, in a simple 

embodiment, where ISI is known to occur from symbols on only one side of the 

decoded symbol dAi, the ith row may contain the symbol estimates Hi={dA , dA 

i-K i- 

dA } . In the more general case, where ISI may occur from symbols on 

both sides of the decoded symbol dAi. the ith row (Hi) may contain the symbol 

estimates Hi={dA . . .... dA . dA , dA , } , K, the width of the H 

I-K2 -1 1 + 1 i+Kl 

matrix, may be determined by the number of adjacent symbols that are expected to 
contribute to ISI corruption. 

[0022] During ISI estimation, different samples x may be assigned relative weights based 
upon associated reliability factors R(xn) of the samples. In a first embodiment, a 
weight wn,n may be assigned according to a binary weighting scheme. If the reliability 
factor of a sample is equal to or less than a predetermined threshold, the weight wn.n 
may be assigned a first value, otherwise the weight may be a second value. For 
example: 



[0023] 



_fl:ifR(x„)5d„^ 
'^'^^ "la otherwise 



[0024] In this embodiment, a sample xn contributes to ISI estimation if and only if it is a 
reliable symbol. 



[0025] Alternatively, all samples may contribute to ISI estimation, weighted according to 



[0026] 



[0029] 



their reliability facto^^or example: 



[0027] In this embodiment, even those samples xn that do not meet the criterion for 

reliability may contribute to the ISI estimation. However, the contribution of samples 
with very high reliability factors will be much lower than samples with very low 
reliability factors. In other words, reliable symbols have greater contribution to ISI 
estimation than samples that are non-reliable. 

[0028] In another embodiment, all samples may be permitted to contribute to the ISI 

estimate but reliable symbols may be given a very large weight in comparison to non- 
reliable samples. For example: 



l:R(Xn)5d|,m 
f 

R(Xn) 



f , (6) 
— -else ^ ' 



[0030] where f is a ceiling factor that prevents f/R(xn) from exceeding 1 for all non- 
reliable samples. In this embodiment, any sample that meets the criterion for 
reliability may be assigned a predetermined weighting value ("1" in the example of 
Equation 6). All reliable symbols would be equally weighted in the ISI estimation. Any 
sample that fails the criterion for reliability may be assigned a weight that is 
proportional to its calculated reliability. 

[003 1 ] ALTERNATIVE EQUALIZER STRUCTURES BASED ON RELIABLE SYMBOLS 

[0032] Returning to FIG. 2, an embodiment of the equalizer 200 optionally may include a 
reliable symbol detector 250 (shown in phantom) to enable the symbol decoder 210. 
The reliable symbol detector 250 may accept input samples xn and identify which of 
them, if any, as reliable symbols. In this embodiment, the reliable symbol detector 
250 may generate a control signal En that enables the symbol decoder 210 upon 
detection of a first reliable symbol. In this embodiment, the reliable symbol detector 
250 inhibits operation of the equalizer 200 until a first reliable symbol is detected 
from the sequence X of captured samples. 



[0033] 



Although the foregoing embodiments have described the equalizer 200 as 
employing a purely blind equalization process, the present invention does not 
preclude use of training symbols. Training symbols may be a transmitted to provide at 



the destination 1 20^^mber of received samples that can b^^ed as alternatives to 
reliable symbols. Following receipt of the training symbol samples, the equalizer 200 
may process other samples xn in a blind fashion as described in the foregoing 
embodiments. This embodiment represents an improvement over other equalizers for 
high-order constellations because, even though training symbols would be used in 
the present invention, the training symbols would be of reduced number as compared 
with known systems. Such a short training sequence may not be of sufficient length to 
allow complete equalization of the channel but may allow IS! adaptation to begin. In 
such an embodiment, if successive groups of training symbols are used the period 
between groups of training symbols may be long compared to the dynamics of the 
channel and the present invention would continue to equalize the channel during the 
period between training samples. 

[0034] THE SYMBOL DECODER 

[0035] The Subtractive Equalizer 

[0036] Several embodiments of symbol decoders 210. 610 may be employed for use in 
the equalizers of FIGS. 2 and 4. A first embodiment is shown in phantom in FIG. 4. 
symbol decoder 61 0 may include a subtractive equalizer 680 and a hard decision unit 
690. In one embodiment the subtractive equalizer 680 may generate a re-scattered 
sample yn from the captured sample xn according to: 

[0037] 

K, 

yn=5(n-5:a,.dn_, (13) 
1=1 

[0038] where coefficients a^i represent a current ISI estimate and dA represent 

n-i 

previously decoded symbols. Initially, for the first frame, the ISI estimate may be set 

arbitrarily, such as a^\=0 for all i. Also, the d^ that antedates the first captured 

n-i 

sample may be set arbitrarily, such as dA =l . The hard decision unit 690 may 

n-i 

generate decoded symbols d^n from respective re-scattered samples yn. For example, 
the hard decision unit 690 may generate a decoded symbol d^n as the constellation 
point closest to the re-scattered sample yn. 

[0039] 

In an embodiment where the symbol decoder 610 includes a subtractive equalizer 
680 and a hard decision unit 690. ISI estimation may be performed using the re- 
scattered samples yn rather than the estimated symbols d^n. ISI coefficients may be 
estimated according to the techniques disclosed in Equation 3 but, in this 



embodiment, the ve^^ A may represent differences betwee^^ received samples xn 
and the re-scattered samples yn ( A n={xn-yn} ) and the matrix H may contain 
surrounding re-scattered samples. In this embodiment, re-scattered samples yn from 
the subtractive equalizer 680 may be input to the ISI estimator 620 instead of the 
estimated symbols d^n (shown in phantom in FIG. 4). 

[0040] In this embodiment, the H matrix may be populated by re-scattered samples 
obtained from the subtractive equalizer. Each row of the matrix may contain re- 
scattered samples surrounding the sample to which the row refers. For example, an 
ith row may relate to a symbol estimate yi. In a simple embodiment, where ISI is 
known to occur from symbols on only one side of the rescattered sample yi, the ith 

row may contain the rescattered samples Hi={y . ^ , y . y . I. In the more 

i-K i-(K-l) 1-1 

general case, where ISI may occur from symbols on both sides of the rescattered 

sample yi, the ith row may contain the rescattered samples Hi={y , y . v 

^ i-K2 1-1'^ 

. , » y . ^..l K. the width of the H matrix, may be determined from the number 
adjacent symbols that are expected to contribute to ISI corruption. 

[0041] In an embodiment the subtractive equalizer 680 may be used for a feedback filter 
in a decision feedback equalizer (DFE). 

[0042] Symbol Detection Using Maximum Likelihood 

[0043] In other embodiments, a symbol decoder 210 (FIG. 2) may operate according to 
the well-known maximum likelihood estimation framework. The captured sample xn 
may be given by Equation 2 above: 



[0044] 



a,.dn_,+c?n (17) 

1*0 



[0045] The maximum likelihood estimate of the transmitted signals {dn} conditioned on 
the observations {xn} may be given by maximizing the likelihood of the observations. 
This is simply the conditional probability of the captured sample xn conditioned on 



[0046] 



[0047] 



knowing the past transmitted signals {h ^ } and the ISI coefficients {ai}: 



dr={hS:maxPr(Xn|a^) i e [-^i^Kal.i * 0; h|i e D)} (18) 



Finding the maximum likelihood estimate of the present transmitted signal dn 
depends upon knowledge of both the past transmitted signals and the ISI coefficients 



{an}. The probabilit^^isity function of xn given {dn} and {a^^simply the probability 
density function of the noise oj n evaluated at: 



[0048] 



t*A=Xn-Cln- Ia,dn., . (19) 
i*-K, 
(«0 



[0049] Then, the probability density function of Equation 1 9 can be expressed in terms of 
a series of further conditioned probability functions, which leads to: 



[0050] 



^n^2 5 X 



(20) 



[0051] where 
[0052] 

§ f()= 2 -E Z -Ji) ■ 

[0053] denotes the whole set of summation of the function. f(*). each summation running 
over the whole set of possible constellation points, and 



[0054] 



[0055] denotes the set of the M possible sequences of possible values for the 

surrounding symbols.. This technique averages over all possible past transmitted 
sequences. The technique also renders lack of knowledge of the ISI coefficients 
inconsequential, assuming, of course, that the probability distribution of the ISI 
coefficients is known instead. In what follows the ISI distribution is taken to be a 
uniform distribution. 

[0056] The compound probability rule states that Pr(A.B)=Pr(A|B)Pr(B), which after some 
straightforward manipulation provides the following for Equation 20: 

[0057] 

Pr^n |h!5)= Z JPr(cJhS.a.D^^>rfe)Prta;}la (21) 

[0058] 

where, Pr(a) is a probability density function (pdf) associated with the ISI 
coefficients, and 



is a pdf associated with the related surrounding symbols set. 

[0059] Assuming additive white Gaussian noise of zero mean and variance a ^ . then the 
standard probability density formula for Gaussian noise may be applied: 



[0060] 



PK''nlhR)=_^^/-^e 2.' Prfe)4-|^|)te. (22) 



[0061] Finally, for the re-scattered received signal: 
[0062] 



t— fVl 1 

""'^^ ""^°o§f ^ '''fe)PfcK:^5 (23) 

[0063] where the decision to the received symbol is carried through: 
[0064] 

dn = {hi; : maxPr(Xn | hj* € D)} . (24) 

[0065] Equation 23, called the "average likelihood" estimation of a hypothesis symbol h ^ 
at time n, serves as a basis for decoding symbols. In essence, Equation 23 takes 

captured signal samples xn and removes the effects of ISI through re-scattering, 

accomplished through the second term of the exponential ( 

l=-K, 

). At a destination, for each sample xn, Equation 23 may be performed for every point 

h in the governing constellation. A decoded symbol dAn may be estimated as the 
" k 

point h ^ having the largest probability of occurrence. 

[0066] The evaluation of Equation 23 is believed to provide near optimal symbol 

detection when the ISI coefficients and the transmitted data are unknown. However, it 
is very difficult to implement in a real-time computing device. Accordingly, other 
embodiments of the present invention are approximations of the evaluation of 
Equation 23 that are computationally less complex. These embodiments are discussed 
below. 



[0067] 
[0068] 



Symbol Decoding Using Trellis Based Detection 



In another embodiment of the symbol decoder 210, when decoding a sample xn. 



probability estimati^^enerated from the surrounding sym^^amples xn-1 to xn- 
N may be used. Thus, probabilities for all possible transmitted symbols, 

^ ^ [-Kl.K2].i ^ 0 . 

, may be stored for the surrounding symbols. Where IS! coefficients are known to be 
real, these probabilities represent 

branches in a trellis (i.e. possible combinations of surrounding symbols). For complex 

Kl +K2 

IS! coefficients, the trellis may include M branches. The probability of an mth 

branch in the trellis 

may be represented as: 



rip+n-,K.j (25) 

[0070] More conveniently, the calculation may be evaluated for the logarithm of the 
probabilities (and later converted back to a probability form), 

[0071] 



[0069] 



f logKk.lh^.,)) (26) 

[0072] Either of these results may be used with a trellis decoder to obtain the likelihood- 
based estimate for dAn according to Equation 23. 

[0073] Symbol Decoding Using IS! Coefficient Statistics 

[0074] Statistical distributions of the IS! coefficients may yield further computational 
simplifications according to an embodiment of the symbol decoder 210. Unless 
otherwise known, in this embodiment, the ISI coefficients may be considered to be 
uniform over their specified ranges 

... tk^ ... 
f-K,' '^-I'^l- '^K, 

. In this case, Equation 23 becomes: 

[0075] 

p4cnih!;)= ri U- " I J-^ pk:k)^- (27) 



[0076] Since the constd 



1*0 

is independent of h ^ , it may be omitted from calculation. 
[0077] Symbol Decoding Using Past Decisions 

[0078] In the embodiments discussed previously, 

represents the probability of the various possible symbol sequences that can result in 
the observed sample xn. The symbol decoder 210 embodiments discussed previously 
rely upon a maximum likelihood ~ when considering a sample at time n, each of the 
symbols d^ ^ ^ were generated from the maximum probabilities at the previous 
iterations. In an embodiment in which Kl is not equal to zero but where its 
contributions may be neglected; rather than calculate 

anew for each sample xn, the most likely symbol sequence may be assumed to be 
symbol sequence 

that includes the previously estimated symbols 
that is, it may be assumed that 

. Therefore, Equation 27 may be simplified further: 



[0079] 



pr^nhl!)-ri 
(=1 



1 - 5-2 



I / ft 2a^ da. (28) 



[0080] Again, the constant 

i=-K,l a, 

is independent of h _ and may be omitted from calculation. 
[0081] Eliminating ISI Ranges in Symbol Decoding 

[0082] Another embodiment of the symbol decoder 210 simplifies the evaluation of 
Equation 23 by using the estimate of the ISI coefficients, a^i. in this embodiment, 
symbol estimation may occur according to maximum likelihood estimation of: 



[0083] 




[0084] Because of the minus sign in the argument of Equation 29, the estimation may 
become a minimum likelihood analysis: 

[0085] 

dn = |hl5:min n^XnjhS g D^j . (30) 

[0086] It can be observed that this is in fact the subtractive equalizer discussed in 
Paragraphs 41-44, 

[0087] USING •RELIABLE SYMBOLS' FOR ESTIMATION 

[0088] According to an embodiment, identification of a reliable symbol may be made 
based upon re-scattered symbols yn rather than the captured samples xn. During 
operation of the equalizer 200, after an arbitrary number of iterations, the equalizer 
200 may produce a set of ISI coefficient estimates, a^j, each with an associated error, 
a~i, such that 

[0089] 

ai = a, + a,. (31) 

[0090] The partially equalized signal may be written as: 
[0091] 

yn=xn- Ea,dn_,. (32) 
t#0 

[0092] Substituting into Equation 2 yields: 
[0093] 

K K 

Yn =dn + f (ai -a,)dn., + ICdnn -dn.,)a, , (33) 

[0094] which by examining Equation (28) and defining the error of the estimated symbol 
as d'^i=di+d-i, Equation (30) becomes 

[0095] 

Vn-dn- ^ a,dn_,- ^a,dn.,+a)n (34) 
i=-K, i=-K, 
1*0 t^O 



[0096] 



This is a genera^^ion of Equation 2, where the ISI estin^p^ are completely 
unknown, so that yAn=y'n and a-i=-ai . 



[0097] From Equation 34, the residual ISI on the partially equalized symbol point, yn, 
becomes the inner product of the surrounding data symbols with the ISI error 
coefficients, a-i. and an additional inner product of the decision errors and the ISI 
coefficients. Since the ISI error coefficients are smaller then the ISI coefficients, 
surrounding symbols with higher energy will contribute less to the ISI than they would 
under the structure of Equation 2. Thus, the probability of identifying a sample as a 
reliable symbol increases, even though the energies of surrounding symbols can be 
large. As the quality of the estimate increases, the inner product 
ia,dn-, 

will remain acceptably low even for surrounding symbols of relatively high energy. 

[0098] Several embodiments of the present invention are specifically illustrated and 

described herein. However, it will be appreciated that modifications and variations of 
the present invention are covered by the above teachings and within the purview of 
the appended claims without departing from the spirit and intended scope of the 
invention. 



